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I. BASIC CONSTRUCTIONS 

The basis of network science are construction proce- 
dures. 

There are four main constructions of networks (and a 
large number of their versions and variations): 

(1) Classical random graphs of Erdos and Renyi |l]] 
(~ 1960). 

In general terms, these are graphs with a fixed 
number of vertices, which are connected, at ran- 
dom, by edges. Classical random graphs have a 
Poisson degree distribution. 

(2) The random graphs with a given degree distribution, 
or, more rigorously, the labeled random graphs 
with a given degree sequence, which are also called 
the configuration model, see a long list of references 
§ starting from 1972 (!). 

In general terms, these are graphs, maximum 
random under the constraint that their degree dis- 
tribution is a given function. When this function is 
Poisson, (2) is reduced to (1). 

(3) Small-world networks which were introduced by 
Watts and Strogatz || (1998). 

In general terms, this is the superposition of reg- 
ular lattices and the classical random graphs. The 
small-world networks combine the compactness of 
the classical random graphs and the strong clus- 
tering of many regular lattices. This construction 
realize a simple way of the introduction of the par- 
ticular type of correlations (the clustering) in net- 
works. 

(4) Networks, growing under the mechanism of prefer- 
ential linking which were introduced by Barabasi 
and Albert § (1999). 

Into this class of constructions, we include much 
more general models of networks, evolving by the 
addition of vertices and edges, than the original 
Barabasi- Albert model. For example, random link- 
ing is a particular case of the preferential linking. 



II. EQUILIBRIUM AND NONEQUILIBRIUM 
NETWORKS 



As the objects of statistical physics, networks can be 
equilibrium (1, 2, 3) < ► nonequilibrium (4). 

The second division is according to the form of degree 
distributions: 

rapidly decreasing degree distributions 

fat-tailed degree distributions 
(with divergent higher moments). 

The third division is into 

uncorrelated (1, 2) < ► correlated (3, 4) networks. 

Uncorrelated random graphs with a given degree dis- 
tribution (2) have a tree-like (locally) structure. The 
structure of these networks, from the point of view of 
a vertex, belonging to a "giant connected component" , 
is schematically shown in Fig. |l|. Notice that loops are 
present only at a large scale. 




FIG. 1. 
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III. EQUILIBRIUM UNCORRELATED 
NETWORKS 

A. Configuration construction 

In statistical mechanics 

a random network is a statistical ensemble of graphs. 

That is, what is observed are members of statistical en- 
sembles, or, which is the same, their particular realiza- 
tions. 

A random graph with a given degree distribution (the 
configuration model (2)) is a statistical ensemble, which 
includes all possible networks with a given degree dis- 
tribution and given numbers of vertices N and edges L. 
Each member of the ensemble is taken with an equal sta- 
tistical weight. 

In fact, these are maximum random graphs under the 
constraint that their degree distributions are given func- 
tions. 

To construct a large typical realization of this graph, 
one can use the following procedure (see Fig. |J): 

(i) Prepare N vertices, i = 1, . . . , N. 

(ii) Attach to each vertex ki ends of edges taken from 
the given distribution P(k). 

(iii) Connect at random ends of pairs of quills of the 
resulting "family of hedgehogs" . 




FIG. 2. 



B. Dynamical construction 

These graphs can be also constructed dynamically by 
many ways (see Refs. For example, let N and L 

be fixed. 



• At each time step, rewire a randomly chosen end of 
a randomly chosen edge to a preferentially chosen 
vertex: the probability that the edge end becomes 
attached to a vertex of degree k is proportional to 
a function f(k) of this degree. 

In the long-time limit, the network will have a stationary 
degree distribution which is determined by the form of 

/(*)■ 

For example, if f(k) cx k + 1 — 7 for k — > 00, 
the network is scale-free at some critical value of the mean 
degree, k c , P c (k) oc /c~ 7 (see Fig. ||). 
For smaller k, this power law has a size-independent cut- 
off. _ 

For k > k c , a finite fraction of edges is condensed on a 
single (or a few) vertices, and the rest vertices have the 
same degree distribution as at the critical point ^,||J8). 
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IV. NONEQUILIBRIUM NONGROWING 
SCALE-FREE NETS 



Even networks with a constant number of vertices and 
edges may be nonequilibrium and may be "scale-free ". See 
the following illustrative example of a network with finite 
numbers of vertices N and edges L, k = 2L/N (Fig. ||). 

(i) At each time step choose, at random, a vertex. 

(ii) Rewire all the edge ends from this vertex to pref- 
erentially chosen vertices. 

(iii) For each of these ends, the probability that it be- 
comes attached to a vertex of degree k is propor- 
tional to k + A. 

The resulting network (in the long-time limit) is scale 
free: P{k) oc fc~ 7 with exponent 7 = 2 + A/k. 
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FIG. 4. 



Another example is: 

(i) At each time step choose, at random, a vertex. 

(ii) Rewire all the edge ends from this vertex to ver- 
tices, which are chosen according to the following 
rule: 

(a) with probability p, an edge end is rewired to a 
randomly chosen vertex, 

(b) with probability 1 — p, an edge end is rewired 
to a vertex chosen with preference, proportional to 
its degree k. 

The resulting network (in the long-time limit) is scale 
free: P{k) oc fc~ 7 with exponent 7 = 2 + p/(l — p). 



V. TYPES OF CORRELATIONS 

The very particular kinds of correlations are: 

(a) Correlations of the degrees of nearest-neighbor ver- 
tices. This means that the joint degree-degree dis- 
tribution of end vertices of edges does not factor: 

(b) Loops, and so, in particular, clustering, since the 
clustering, in general terms, is the concentration of 
loops of length three in a network. 

In uncorrelated networks, loops and clustering are only 
size effects. 

The growth of a network produces a wide spectrum of 
correlations which cannot be reduced to only (a) and (b). 



VI. WHEN PAIR CORRELATIONS ARE 
IMPORTANT 

For example, 



• In uncorrelated scale-free equilibrium networks 
with 7 < 3, an average shortest-path length I(N) 
grows with a number of vertices N slower than N 
(a super-small- world effect [||). 



• On the other hand, as a rule, pair correlations in 
real nets are such that the average degree of the 
nearest neighbors of a vertex is a decreasing func- 
tion k nn (k) of its degree k. In such a situation, a 
standard relation I ~ In N/ Ink is valid. 

In a number of real nets, £(N) is nearly constant in 
a wide range of variation of N (see, e.g., networks of 
metabolic reactions ]l0|). The reason for this constancy 
is not "the super-small-world effect" but the increase of 
k(N) with N: these nets become more "dense" as they 
grow. 

Notice that in all the real scale-free nets, the ratio 
@real /(In N/ In k) is in a surprisingly narrow range be- 
tween 1/2 and 2. 



VII. WHEN LOOPS ARE IMPORTANT 



In statistical physics, and so in networks, loops are re- 
sponsible for fluctuation phenomena in a critical region. 



VIII. PAIR DEGREE-DEGREE CORRELATIONS 
IN GROWING NETWORKS 



Pair degree-degree correlations is the generic property 
of growing networks. 

For example, consider a scale-free citation graph. By 
definition, a citation graph is a growing network, in which 
new connections between already existing vertices are im- 
possible: new edges connect new and old vertices. 

Let 7 < 3. Then, the asymptotic expression for the 
joint degree-degree distribution for nearest neighbor 
vertices is 

P(M') V (7-1) *'- a • (2) 

This gives the following form of the average degree of the 
nearest neighbors of a vertex as a function k nn (k) of its 
degree k (see Fig. ||): 

• at small enough k, k nn {k) cx /c~( 3 ^; 

• at larger k, k nn logarithmically depends on k. 
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FIG. 5. 



So, in this respect, the case 7 = 3, that is, the 
Barabasi- Albert model, is exceptional: in this event, the 
pair correlations are small. 

When 7 of a citation graph is greater than 3, the slope 
of the curve in Fig. || becomes positive. Even if the 
attaching is random (the net is exponential) the strong 
pair correlations are present: for the highest degree fc, 

fcnn(fc) ^ fc; and fcnn(l) = fc- 

One can easily change pair correlations by changing, 
e.g., an additional attractiveness A in the preference 
function fc + A. One can also regulate correlations by 
introducing, in addition, a new channel of linking of al- 
ready existing edges. So, the slope of the dependence 
fcnn(fc) strongly depends on a model. 

One may say, the smallness of pair correlations in grow- 
ing networks is a rare event and not a standard situation. 
The standard mechanisms of the network growth neces- 
sarily produce these correlations. 



IX. HOW TO CONSTRUCT AN EQUILIBRIUM 
NET WITH GIVEN DEGREE-DEGREE 
CORRELATIONS 



A. Configuration construction 

In the spirit of the configuration model, one can con- 
struct the equilibrium net with a given pair degree-degree 
P(fc, fc') and a given number N of vertices as a statistical 
ensemble. Members of this statistical ensemble are all 
networks with a given P(fc, fc'). Each member is taken 
with an equal statistical weight. 

These are networks, maximum random under the con- 
straint that their pair degree-degree distribution is equal 
to a given P(fc, fc') Q. 

To construct a large typical realization of this graph 
for large N, one can use the following way. 

Notice that in these networks, the ordinary degree dis- 
tribution follows from the degree-degree distribution: 



This relation gives the function P(fc) up to a constant 
factor, which, in turn, can be obtained from the normal- 
ization condition J^k P(^) = 1- Thus we obtain 



fc = 



]TP(fc,fc')/fc 



k.k' 



(4) 



and so the total number of edges is known, L — kN/2. 

So, we have N and L fixed and can formulate the con- 
struction procedure as it follows: 

(i) Using the given P(fc, fc') find the total number of 
edges, L. 

(ii) Create the infinite number L of pairs of integers 
(fc, fc') distributed as P(fc, fc'). These pairs play the 
role of L edges with ends of degrees fc and fc'. 

(iii) Select, at random, groups of ends of degree fc, each 
one consisting of fc ends. Tie them in bunches, each 
of fc tails. These bunches are vertices of degree fc. 

One can check that this procedures is possible in the 
thermodynamic limit, and it generates tree- like (locally) 
graphs with the low number of loops like in uncorrelated 
networks (see Fig. [j]). 



B. Dynamical construction 

An equilibrium random graph with pair degree-degree 
correlations of nearest neighbor vertices also may be con- 
structed dynamically. 

Let us introduce a new category, pair preference and a 
pair preference function, /(fc, fc'). This is a more general 
notion than a one-vertex preference, where the probabil- 
ity that the edge becomes attached, /(fc), depends only 
on the degree of a vertex. Indeed, an edge has not one 
but two ends. In general, they must become attached not 
to one but to two vertices, and so it is a combination of 
two degrees that is natural form of preference. 

Let N and L be fixed. 

• At each time step, we choose, at random, an edge 
and remove it to a pair of vertices of degrees fc and 
fc', which is chosen with probability, proportional 
to a given function /(fc, fc') (see Fig. |6|). 

At long times, the network approaches a state with a 
stationary pair degree-degree degree distribution of near- 
est neighbor vertices, P(fc, fc'), which is determined by the 
form of /(fc, fc'). 

(For growing networks, a similar procedure was dis- 
cussed in the talk of L. Pietronero at this conference.) 
For a related construction procedure, see Ref. 
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FIG. 6. A randomly chosen edge become removed to a 
pair of vertices of degrees k and k' , which is chosen with 
probability, proportional to a preference function f(k,k'). 



X. HOW TO CONSTRUCT A GROWING 
SCALE-FREE NET WITH A GIVEN 
CLUSTERING 
(TOWARDS A REAL-SPACE 
RENORMALIZATION GROUP FOR 
NETWORKS) 

Here we present a simple way to construct random 
growing correlated clustered, scale-free, etc. networks. 
The procedure is based on the stochastic transformation 
of each edge of a network at each step of the evolution. 

Numerous versions of this process are possible. A sim- 
ple particular case is shown in Fig. [?] (a). With some 
probabilities, a vertex is transformed to distinct configu- 
rations of edges and vertices. 



a) 





b) 



(b). For p — > but p ^ 0, this construction coincide 
with a known random network, growing by attaching of 
new vertices to randomly chosen edges. Notice that the 
clustering coefficients of these nets are finite in the large 
network limit. 

Another possible construction, shown in Fig. Q (c), co- 
incides with the Barabasi- Albert model in the case p — » 
but p^O. 

We show only particular configurations on the left- 
hand parts of Fig. (?]. In general, they can be of a 
very general form (see Fig. _0 (a)), and so, they can 
be even trees (Fig. || (b)) fl5|| . Notice, that we used 
only the transformations that produce networks with the 
small-world effect and fat-tailed degree distributions (non- 
fractals: 1(N) oc IniV grows slower than any power of N). 
Compare them, e.g., with contrasting fractal trees |16|. 



a) 



b) 



FIG. 



In fact, the presented transformations are very similar 
to those which are used in a standard real space renormal- 
ization group for disordered lattice models. This is also 
called "positional renormalization group" . The technique 
of the real space renormalization group is well developed 
for disordered lattices. So, its application to these grow- 
ing random networks is a standard routine. 

Note that all the constructions in this talk are analyt- 
ically treatable. 

Thus, correlations in networks are natural. 

* Electronic address: sdorogov@fc.up.pt 
t Electronic address: jfmendes@fc.up.pt 

* Electronic address: samukhin@fc.up.pt 



FIG. 7. 




c) 



If p = 1, we have a deterministic growing graph [114 
Another representation of Fig. (a) is given by Fig 
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